Classical and Quantum Contents of Solvable Game Theory on Hilbert Space 
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A simple and general formulation of the quantum game theory is presented, accommodating 
all possible strategies in the Hilbert space for the first time. The theory is solvable for the two 
strategy quantum game, which is shown to be equivalent to a family of classical games supplemented 
by quantum interference. Our formulation gives a clear perspective to understand why and how 
quantum strategies outmaneuver classical strategies. It also reveals novel aspects of quantum games 
such as the stone-scissor-paper phase sub-game and the fluctuation-induced moderation. 
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Attempts to extend game-theoretical strategies to the 
quantum domain p], 0, |3 have attracted journalistic at- 
tention in the acadèmic community and beyond, with an 
intriguing solution to the classical problem of the Pris- 
oner's Dilemma [5J . The substance of the emerging quan- 
tum game theory, however, is still shrouded in mystery, 
and in spite of the ràpid accumulation of literature pg, 
we still find ad hoc assumptions and arbitrary procedures 
scattered in the field. Quite naturally, there have been 
persistent doubts as to their generality and finality 0,0- 
For the quantum treatment of game strategies to become 
truly a theory, a workable framework to accommodate all 
possible quantum states available in the system, prefer- 
ably with analytic solutions illuminating its structure, is 
l·iighly desired. In particular, it needs to clarify the reason 
behind the puzzling effectiveness of quantum strategies 
in situations where their classical counterparts fail to give 
satisfactory results. 

In this article, we attempt to answer this call with a 
full Hilbert space formulation of the game theory. It is 
shown that assigning vectors in a Hilbert space to game 
strategies entails the introduction of an element that pro- 
vides correlation for the strategies of the individual play- 
ers. For two strategy games, the correlation is generated 
by operators that implement swapping and simultaneous 
renaming of the player's strategies. The quantum game 
is then split into two parts, one consisting of a family of 
classical games and the other representing the genuine 
quantum ingredient of the game. The game, as a whole, 
is solvable. We illustrate our formalism with numerical 
examples on Prisoner's Dilemma and discuss the classical 
and quantum contents appearing in the Nash equilibria. 
We also point out the existence of such curious phenom- 
ena as the stone-scissor-paper game found for phase vari- 
ables of the strategy, and the quantum moderation which 
occurs for fluctuating correlations. 

To present our scheme of quantum game, we first con- 
sider Hilbert spaces Ha and Hb in which the strate- 
gies of the two players A and B are represented by vec- 
tors \a) A £ Ha and \0) B € Hb- The entire space of 
strategy of the game is then given by the direct product 
H = Ha ^Hb- A vector in H represents a joint strategy 



of the two players and can be written as 



|a,/3; 7 )= J(l)\a) A 



' B > 



(1) 



where the unitary operator J("f) provides quantum cor- 
relation (e.g., entanglement) for the separable states 
\a) A \(3) B . Note that J("f) is independent of the play- 
ers' choice and is determined by a third party, which is 
hereafter referred to as the coordinator. 

Once the joint strategy is specified with J( 7 ), the play- 
ers are to receive the payoffs, which are furnished by the 
expectation vàlues of self-adjoint operators A and B: 



U A (a,0;j) = (a,/3;j\A\a,/3;j) , 
II B (a,/3;7) = (a, (3; -y\B\a, f3; 7) 



(2) 



Each of the players then tries to optimize their strategy 
to gain the maximal payoff, and our question is to find, 
if any, a stable strategy vector which corresponds to the 
quantum version of the Nash equilibrium. Namely, we 
seek a point (a,/3) = (a*,0*) in the strategy space at 
which the payoffs separately attain the màxima as 

<Ul4a,/?*; 7 )U=0, í j9 n fl (a*,/3;7)|^=0, (3) 

under arbitrary variations in a and (3. 

A symmetric quantum game is defined by requiring 
that the strategy spaces of the two players are the same 
in dimensionality, àimHA = diraHB = n, and that the 
payoffs are symmetric for two players. The latter condi- 
tion is expressed as 

m(a,#7) =ns(/3,a; 7 ) (4) 

in terms of identically labclcd strategies for both players 

\° í )a = ^ 0í i\ í )a> \0)b = ^2/ 3 í\ í )b> ( 5 ) 



with complex numbers ai, /3j normalized as \ a i\ 2 — 
Sí \Pi\ 2 = 1- Here we have used a common orthonormal 
basis for both of the players, namely, a set of strategies of 
the two players which are in one-to-one correspondence 
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\i) A «-> \i) b f° r * — 0, 1, . . . , n — 1. Introducing the swap 
operator 5 by 

S|U> = M (6) 

for the states = \i) A \j) B , we have S\a,(3) = |/3, a) 
for general separable states \a,0) = \oc) A \(3) B . For our 
convenience, we introduce two more operators G and T 
dcfined by 

C\i,j) = \iJ), T\i,j) = \j,ï), (7) 

where the bar represents the complimentary choice; i 
= (n— 1) — i. The operator G is the simultaneous renam- 
ing (conversion) of strategy for two players, and T is the 
combination T = CS. These operators {S,C,T} com- 
mute among themselves and satisfy S 2 = C 2 = T 2 = I, 
T = SC, S = CT and C = TS. With the identity I, 
they form the dihedral group D%. 

In terms of the correlated payoff operators, 

A( 7 ) = ^(7)^(7), B( 7 ) = jt( 7 )BJ(7), (8) 

we have H A (a, /3; 7) = (a, /3\ »4( 7 ) \cx, (3) . It is convenient 
to choose the unitary operator J( 7 ) such that .4.(0) is 
diagonal in the product basis The game is then 

symmetric if 23(0) = 5.4(0)5, in which case 23(0) is diag- 
onalizcd simultaneously with the eigenvalues swapped, 

(i',f\A(0)\i,j)=A ij S i , i ó rj , (9) 
(t',j'\B(0)\i,j)=A ji 6 i r i 5 j , j . 

Observe that U A (a,0;O) = IL B (fi,a;0) = Y^ij^^-ijVj 
with Xi = |ai| 2 , yj = \(3j\ 2 being the probability of choos- 
ing the strategies \i) A , \j) B - This means that, at 7 = 0, 
our quantum game reduces to the classical game with the 
payoff matrix Aij under mixed strategies. 

Now we restrict ourselves to two strategy games n = 2. 
The entire Hilbert space is spanned by \cx,/3; 7 ) with the 
unitary operator J( 7 ) in the form 

J( 7 ) = J(o) e <7iS/2 e *^r/2 j (1Q) 

where 7 = (71,72) are real parameters. Note that, on 
account of the relation S+T — C — I vàlid for n = 2, only 
two operators are independent in the set {S,C,T}. For 
simplicity, we assume that A is diagonalized under the 
basis \i,j), which implies J(0) = / and -4(0) = A. The 
correlated payoff operator A( 7 ) is split into two terms 

^l(7)=^ pc (7)+-4 in ( 7 ) (11) 

where A pc is the "pseudo classical" term and A ln is the 
"interference" term given, respectively, by 

^p c (7) = cos 2 ^ A + (cos 2 y - cos 2 ^ )SAS+ sin 2 ^ CAC, 

^ in ( 7 ) = lsin 7 i(A5-5A) + % - sm l2 (AT-TA). (12) 

Correspondingly, the full payoff is also split into two con- 
tributions from A pc and A in as U A = U P A + IT£. To 



TABLE I: The quantum Nash equilibria with edge strategies. 
The conditions for their appearance and their maximal payofFs 
under variations of 7 are shown. 
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A Q0 


^00 


Aoi+Aia-Au 


An 



evaluate the payoff, we may choose both aa and 0o to 
be real without loss of generality, and adopt the notaions 
(aQ,ai) = (a ,aie^) and {Posfti) = (^07^i eIX )- The out- 
come is 

nP c (a,/3; 7 )-E a ' 6 K C W' ( 13 ) 
n5(a,j9; 7 ) 

= -a oai ò 6i [G+ (7) sin(£ + x) + G_ (7) sin(^ - x)] , 

with AP c ( 7 ) = (ï,j|AP c (7)N,j) and 

G+(7) = (A 00 - An)sin 72 , (14) 
G_( 7 ) = (Aoi - Ai )sin 7 i. 

The split of the payoff shows that the quantum game 
consists of two ingredients. The first is the pseudo clas- 
sical ingredient associated with H A C in Ijl3|l . whose form 
indicates that we are, in effect, simultaneously playing 
three different classical games, ie., the original classical 
game A, the altruistic game SAS and the converted- 
value game CAC with the mixture specified by given 71 
and 72. Regarding 7 as tunable parameters, we see that 
the quantum game contains a family of classical games 
that includes the original game. The second ingredient of 
the quantum game is the purely quantum component Tl™ , 
which occurs only when both of the two players adopt 
quantum strategies with etoaiòo&i ^ and non-vanishing 
phases £ and %. The structure of U A suggests that this 
interference term cannot be simulated by a classical game 
and hence represents the bona fide quantum aspect. 

We can find the quantum Nash equilibrium strategy 
explicitly by considering the condition © for the payoff 
obtained above. It can be readily confirmed that, modulo 
arbitrary phases, the "edge" strategies \a*,(3*) given by 

|a*,/?*) = |0,0), |1,1), |0,1), |1,0) (15) 

can furnish Nash equilibria, depending on the signs of 
the functions 

H ± {i) = t(A) ± [G' + ( 7 ) + G'_( 7 )] , (16) 

where we define t(A) = Aoq — Aqi — A10 +An and also 
G' + {i) = (A 00 -Aii)cos72, G'_{i) = (A i-Aio)cos 7 i. 
The precise conditions for the appearance of the equi- 
libria, together with their maximal payoffs IK ( 7 ) = 
11^4 {a* (7), f3* (7); 7) obtained under variations of 7, are 
summarized in TABLE I. 
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FIG. 1: The quantum Nash equilibrium payoff 1X^(7) = 1X4(0*, 7) (or IIa(PX, P%\ 7) f° r mixed quantum strategies) 
as a function of 7. Only the region 71,72 G [0, 7r] is shown since 11*1(7) has the reflection invariance II*i(27r — 71,72) = 
ilx(7i,27r — 72)= 11^(71,72). The extra invariance II^(7r — 71,71 — 72) = 11*1(71,72) is also visible, (a) Edge state Nash 
equilibria for j4oo = 3, Ao\ = 0, Au) = 5 and Au — 1. The value (71, 72) = (0.9272, 0) gives the maximum payoff II A = 4 for one of 
the players. (b) Symmetric mixed quantum Nash equilibrium with the same parameters as (a). The maximum payoff II A = 3 
is obtained at 7! = and 1.3694 < 7* < n. (c) Mixed Nash equilibrium for ^4.00 = 3, A01 ~0, Aio = 5 and Au =0.2. The two 
bumps near the left and right ends are due the pure symmetric Nash equilibria 1201 . 



For illustration, let us consider the case where the 
classical game 7 = exhibits the Prisoner's Dilemma, 
A01 <An <Aqq <Aiq. Adopting the numerical vàlues 
used in 0], we observe from FIG. l(a) that two asym- 
metric Nash equilibria coexist in the middle strip that 
separates the two domains where the symmetric Nash 
equilibria arise. The maximal payoff for player A is 
achieved by the equilibrium strategy |1, 0) at the optimal 
choice (7*, 7|)= (2 arcsin \/X, 0), and also by its symmet- 
ric partner |0, 1) at {ir — 2 arcsin vA, n) where we use 



X = (Au-A i)/(A w -Aqi). 



(17) 



Interestingly, the maximal payoff is better than that ob- 
tained when the players decide to "deny" |1, 1) or "con- 
fess" |0, 0). Note that the joint strategies (JTJ of the play- 
ers realized at these Nash equilibria are actually entan- 
gled due to the correlation factor J( 7 ). Indeed, the en- 
tropy of entanglement S(p re d) evaluated for the reduced 
density operator p rc( j |j of the optimal state reads 



S(p ied ) = -X log A — (1 — À) log(l - A), 



(18) 



which is nonvanishing since < A < 1 for the Prisoner's 
Dilemma. The optimal equilibrium, however, does not 
provide a desired resolution for the dilemma, because it 
is achieved at the expense of player B receiving a lower 
payoff. In fact, in the middle strip, the original Prisoner's 
Dilemma turns into the Game of Chicken which has its 
own dilemma of a different kind. 

Leaving the numerical example aside for now, we re- 
turn to the general case, and examine the possibility of 
a pure Nash equilibrium which is not one of the edge 
states. The interference term 11™ now comes into play, 
and applying the condition for phases, í^II^If— we 
obtain 



cos2£* = -G_( 7 )/G + (7). 



(19) 



When \G-\ < \G + \, there is an equilibrium solution 
£ = x — with the payoff II m = aoGi&iòiA( 7 ), where 



A( 7 ) 



Gl 



G 2 _. The condition for the amplitudes 



S ao IÍA — and Sb TÍB = then provides, along with the 
edge state solutions (|15|) . the symmetric solution, 



ff_( 7 )-A( 7 ) 



ír + ( 7 ) + ír_( 7 )-2A( 7 ) 



1/2 



(20) 



which is vàlid (0 < a£ < 1) if {H+ - A)(if_ - A) > 0. 
There is no asymmetric pure Nash equilibria apart from 
the two edge solutions. 

When \G-\ > \G+\, there is no dominant strategy for 
the phases: the player A tries to top player B by choosing 
a phase which is off by 7t/2 to maximize II™. The player 
B does the same, and if the game is played repeatedly, 
the result is a uniform random distribution for both £ 
and x- This is a continuous version of the paper-scissor- 
stone game for phases, and results in the zero average 
for the interference term, = 0. Thus, we reach for- 
mally the same symmetric solution l|20|) with A( 7 ) = 0. 
The existence requirement of the solution simplifies to 
H + H- > for this case, and we find, from TABLE I, 
that the equilibrium appears precisely in the region of 
the asymmetric pure Nash equilibria. 

The foregoing argument is made formal by considering 
the mixed quantum strategies specified by probability dis- 
tributions Pa(cí), Pb{P) over the players' actions normal- 
ized under suitable measures da, d/3. The distribution- 
averaged payoff can be defined as Ux {Pa , Pb i 7 ) = 
/ dadf3P A (a)n x (a, (3;j)P B (f3) for X = A,B. The play- 
ers seek a distribution Pa = Pb = P* which simultane- 
ously maximize TLa(Pa, Pb',j) and ILb(Pa, Pb', 7 ). Such 
a distribution furnishes a mixed quantum Nash equilib- 
rium, extending the concept of the pure quantum Nash 
equilibrium specified by single vàlues of a and (3. Note, 
however, that the latter is already probabilistic in terms 
of classical strategies, possessing a classical mixed strat- 
egy game as a subset. The former, on the other hand, 
is probabilistic in terms of quantum strategies, and is 
realized by an ensemble of quantum systems. 
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In FIG. l(b), the mixed quantum Nash equilibrium 
payoff for the Prisoner's Dilemma of FIG. l(a) is shown 
as a function of 7. In the middle strip, asymmetric equi- 
libria, which are known to be dynamically unstable jlCj . 
are now replaced by the mixed Nash equilibrium given 
by H2()(l with A(7) = 0. The global maximum of the 
payoff 11^(7*) = Aqo is attained along the line 72=0, 
2axcsm^/fj < 7Í < ir with rj = (A 10 - A 00 )/(A 10 - A Q1 ). 
We mention that the quantum Nash equilibrium found 
in corresponds to (71,72) = (7r/2,0) in our scheme. 
Unlike the optimal point |1,0), the joint strategy state 
of this equilibrium remains to be |0,0) and hence is not 
cntangled. In fact, the entanglement of the Nash equilib- 
rium is inessential in this example, since the intcrfcrcncc 
term vanishes for all parameter vàlues, leaving only clas- 
sically interpretable terms. 

The truly quantum characteristics of the game mani- 
fests itself when the non-edge solution (|2ÜI) appears. We 
show an example of such cases in FIG. l(c) which is ob- 
tained by modifying the payoff parameters slightly from 
the previous ones. Here, the Nash equilibria l|2U|) con- 
tributes to the increase of the payoff as seen by the convex 
structures at the two ends. Examination of the solution 
to other types of quantum games |lll IT^ would naturally 
be the next task. 

Thcre are sevcral diffcrent interpretations possible for 
the role of the coordinator J(j). The first is that it fur- 
nishcs the unitary family of payoff operators A("f) from 
a given classical payoff matrix Aij , and therefore acts in- 
dependently from the two players. The second is that it 
acts as a collaborator to the players and serves to max- 
imize the payoff at the Nash equilibria by tuning 7 as 
(J-yn^l-y* = 0. In the above numerical examples, we have 
started from the first interpretation and tacitly moved to 
the second. Yet another interpretation of the coordinator 
is that it generates quantum fluctuations for the payoffs 
by randomizing the parameter 7. In this case, the game 



is effectively given as an average over the fluctuations, 
and may be studied by integrating out the parameters 71 
and 72. At the level of the payoff operator, the outcome 
is expressed as 

J d 11 d l2 A{ 1 )= l -A+ l -CAC 1 (21) 

which implies that the quantum fluctuations yield quan- 
tum moderation to the game by washing out the individ- 
ual's preference. 

We conclude this article by examining the quantum 
and classical aspects of strategies in our formulation. We 
first stress that our treatment is based on the full set of 
quantum strategies, and thus the quantum Nash equi- 
libria obtained here are truly optimal within the entire 
Hilbert space. 

Among the quantum Nash equilibria, those obtained 
within the classical family can always be simulated by 
some classical means, even when their joint strategy 
states are entangled in the Hilbert space. In a sense, these 
classically realizable quantum strategies are the possible 
link between the quantum game theory and the classical 
games in macroscopic social and ecological settings. In 
contrast, the quantum solutions that arise only with the 
interference terms represent the first gcnuinely quantum 
Nash equilibria, offering superior payoffs, that have no 
counterparts in classical strategies, 

For the comprehensive classification of the quantum 
games in our scheme, the full analysis of the classical 
family is indispensable. This should also pave the way to 
the extension for games with more than two strategies 
and two players. 

One of the authors (TC) thanks the members of the 
Institute of Particle and Nuclear Studies at KEK for the 
hospitality granted to him during his entended stay. 
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